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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time nnay be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

Responsive to comnnunication(s) filed on . 

2a)n This action is FINAL. 2b)l3 This action is non-final. 

3) \3 Since this application is in condition for allowance except for fonrial matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) *^ Claim(s) /'^^ is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) 0 Claim(s) is/are allowed. 

6) 13 Claim(s) 1-29 is/are rejected. 
?)□ Claim(s) is/are objected to. 

8) 0 Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10) n The drawing(s) filed on is/are: a)n accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) 0 The oath or declaration is objected to by the Examiner Note the attached Office Action or fonn PTO-152. 
Priority under 35 U.S.C. §§119 and 120 

12) n Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a)nAII b)n Some*c)n None of: 

1 .□ Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application No. . 

3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

13) n Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 1 19(e) (to a provisional application) 

since a specific reference was included in the first sentence of the specification or in an Application Data Sheet. 
37 CFR 1.78. 

a) □ The translation of the foreign language provisional application has been received. 

14) 0 Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121 since a specific 

reference was included in the first sentence of the specification or in an Application Data Sheet. 37 CFR 1.78. 
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DETAILED ACTION 



Claim Rejections - 35 USC § 102 

1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that fomn the basis for 
the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1 ) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

2. Claims 1-6 and 14-23 are rejected under 35 U.S.C. 102(e) as being anticipated by Nayar. 



Claim 1 , 14, 15 A method for generating a selectable perspective view of a portion of a 
hemispherical image scene, comprising the steps of: 

acquiring an omnidirectional image on an image plane using a reflective mirror that 
satisfies a single viewpoint constraint and an image sensor; (See Nayar column 13 lines 
10-30) 

defining a perspective viewing window based on configuration parameters; (See column 
7 lines 62-65 and column 10 lines 56-65) 

defining a predetermined geometric relationship between the reflective mirror and the 
image plane; and (See column 9 line 63 through column 10 line 19) 
mapping each pixel in the perspective window with a corresponding pixel value in the 
omnidirectional image on the image plane using the configuration parameters. (See 
column 10 line 55 through column 1 1 line 55 as well as column 12 lines 25-35.) 



Claim 2, 18. The method of claim 1, wherein the configuration parameters defined in the defining 
step include at least one of a zoom distance defined as the distance from the focal point 
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of said reflective mirror to said window, a pan angle defined as the angle between the x 
axis and a line through the focal point of said reflective mirror perpendicular to the x-y 
plane and a tilt angle defined as the angle between the x-y plane and a vector normal to 
said window. (See column 10 lines 55-65) 

Claim 3, 19. The method of claim 2, wherein the defining step is conducted via a user interface 
through which a user enters data corresponding to at least one of a desired zoom 
distance, pan angle, or tilt angle. (See Column 7 lines 62-65) 

Claim 4, 16, 17, 20 The method of claim 1, wherein the mapping step includes the step of 
generating a mapping matrix by: 

applying a ray tracing algorithm to each pixel in the perspective viewing window to 
determine a corresponding reflection point on the reflective mirror; and projecting each 
reflection point to a focal point of the image sensor to determine the corresponding 
location in the omni directional image on the image plane. (See figures 4, 5,and 6) 

Claim 5, 22, 23. The method of claim 4, further comprising the step of storing the mapping matrix 
in a module having a memory, (See Nayar figure 1 A item 125. Computers all have 



Claim 6, 21 . The method of claim 1 wherein the step of defining a perspective viewing window 

defines the perspective viewing window as a panoramic viewing window. See column 1 1 



3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 

rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 



memory) 



lines 25-30) 



Claim Rejections - 35 USC § 103 
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4. Claims 7-9, 24 and 25 are rejected under 35 U.S.C. 103(a) as being unpatentable over Nayar as 

applied to claim 1 above, and further in view of Chahl and Mick. 

5. 

Claim 7, 24: The method of claim 1 , further comprising the steps of: calculating a residual image 
based on a difference between a reference omni-directional image and a sequential 
omni-directional image; determining if the residual image contains any value that exceeds 
a predetermined threshold; and classifying any value that exceeds the predetemnined 
threshold as an anomaly. (Nayar cleariy teaches that his system can be used for 
surveillance purposes see column 1 lines 25-30. While he is not specific as to his motion 
detection means Chahl clearly teaches that motion detection can be done in a panoramic 
surveillance system see column 6 lines 25-32. However, he does not specify how he 
does his motion detection. However, at the time the invention was made, it was well 
known in the art of surveillance, that in order to detect video motion, the conventional way 
was to compare subsequent video images and if a large enough difference in the images 
is detected, it is considered motion. As proof of the Examiners statements he includes 
Mick, see abstract. Therefore, at the time the invention was made, it would have been 
obvious to one of ordinary skill in the art, to include motion detection capabilities in 
Nayars system in order to adapt it for use in the surveillance application he says it can be 
used for.) 

Claim 8: The method of claim 7, further comprising the steps of: calculating the configuration 
parameters for the perspective viewing window from the anomaly; and selectively 
focusing the perspective viewing window on the anomaly using the calculated 
configuration parameters. (See Nayar column 10 lines 32-64) 

Claim 9, 25. The method of claim 7, further comprising the step of activating an alarm if at least a 
portion of the residual image exceeds a predetennined threshold. (See Chahl abstract.) 
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6. Claim 10-13,26-29 rejected under 35 U.S.C. 103(a) as being unpatentable over Nayar as applied 
to claim 1 above, and further in view of Baker. 

Claim 10, 26. The method of claim 1, further comprising the steps of: detecting a location of a 
sound source in the image scene; and adjusting the perspective viewing window based 
on the detected location of the sound source. While Nayar does not include this feature, 
he does state in column 1 line 26 that his system could be used for teleconferencing. 
Baker on the other hand, discloses a teleconferencing imaging system that includes a 
panoramic imaging means including an audio detection circuit that can locate the source 
of a sound and image it. See Baker abstract. Therefore, at the time the invention was 
made it was well known in the art, that imaging the source of a sound was desired, thus it 
would have been obvious to one of ordinary skill in the art, to include the audio detection 
system disclosed by Baker into Nayar's imaging apparatus to make the invention as 
claimed. 

Claim 11, 12, 27, 28. The method of claim 1, further comprising the step of transmitting the omni- 
directional image via the Internet. (At the time the invention was made, use of the 
internet for transmitting images was well known in the art. Once the image is processed 
as in the case of the current invention, data is data, therefore it doesn't matter that the 
image came from an omni-directional imaging means. Never the less, while Nayar is 
silent on use of the Internet, Baker teaches that teleconferencing involves transmitting 
both the audio and video data to a remote site for viewing. See column 1 lines 16-17. 
Since teleconferencing implies use of the phone system, and access to the internet is 
achieved via the phone network, it would have been obvious to one of ordinary skill in the 
art to transmit the image via a server or any computer capable of handling the job in 
order to provide a suitable teleconferencing system.) 
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Claim 13, 29. The method of claim 1, further comprising the step of fonning a two way 



transmission link between the image sensor and a remote display, wherein the two-way 



transmission link transmits at least one of the omni-directional image, the perspective 



viewing window, and an audio signal. (Teleconferencing is a two way transmission link.) 



Any inquiry concerning this communication or earlier communications from the examiner should 
be directed to Charles E Parsons whose telephone number is 703-305-3862. The examiner can nomnally 
be reached on IVI-TH 7AM to 5 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, 
Chris Kelley can be reached on 703-305-4856. The fax phone number for the organization where this 
application or proceeding is assigned is 703-872-9314. 

Any inquiry of a general nature or relating to the status of this application or proceeding should be 
directed to the receptionist whose telephone number is 703-305-4750. 
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